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COMPARATIVE ANALYSIS OF VARIOUS APPROACHES 


FOR EVALUATION OF PARAMETERS^ 
OF MULTIDIMENSIONAL MODELS 

L. S. Gurin 


I. Formulation of the Problem 


/ 3 * 


Let us examine the problem of evaluating parameters of a 
multidimensional model according to measurement results: Let 

X jX’mY — vector of independent variables, and 

— vector of evaluated parameters. Further, 
the measured value _3_ may he presented in the form 

= > ! ( 1 ) 

where the form of function I , which represents the 

model studied, may be either given or selected on the basis of 
measurement results, and certain assumptions may be made about 
random error ^ '. We will suppose that measurements are con- 

ducted at point's jX i f t = N , determined by the plan of the 
experiment. It is necessary to find the best evaluation of the 
unknown vector of parameters i Q 1 . The possible approaches to 
solution of this problem depend on the following conditions: 

1. Is the model given or is it selected? 

2. Tf the model is given, is the experiment plan also 
given? If the plan is not given, it becomes neces- 
sary to select the best plan (the problem of planning 
the experiment.) . 

"* \ 

3. Is the law of error distribution j^' given? 


Numbers in margin indicate pagination of original foreign text. 
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4. Whatj are the criteria for selecting the best 
evaluation? 

5- What is the purpose of conducting the research? 

The last point is the most important, since it determines 
the dependence between the remaining points. Therefore, we 
shall formulate the goal of the investigation conducted in 
this work. 

Due to the complexity of multidimensional dependences, 
many researchers consider it more expedient to produce decom- 
position of a model, ie., to study the dependence of the final 
value on each of the unknown variables X i , individually , fix- 
ing whenever possible the values of the remaining independent 
variables. If such decomposition is performed before the be- 
ginning of the experiment, it is expressed in the appropriate 
selection of experiment plan. This approach is severely 
criticized in [1] from the standpoint of planning the experi- 
ment. If the experiment has already been conducted and its 
plan did not correspond to the idea of decomposition, it is 
possible to perform approximate decomposition during process- 
ing of the results of the experiment (so-called plotting seg- 
ments, see'.' [2]). 

On the other hand, when the experiment has been planned 
according to the scheme of decomposition, during processing 
we may perform reverse composition, returning to the model (1) 
in its overall multidimensional form. 

Our goal is to clarify the dependence of the feasibility 
of decomposition on the circumstances formulated above. 
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/ 

Some General Considerations 


Returning to [1] , let us stress that here the authors 
examine only the case where the model is given. If the model 
is to be selected, then decomposition is necessary at the 
planning stage of the experiment or at least at the process- 
ing stage in order to define the problem and to at least out- 
line a certain number of competitive models for subsequent 
study. 

However, let us examine more closely the case where the- /5 

experiment has already been conducted according to the method 
of decomposition and we are speaking only of selecting the 
method of processing. 

We will begin with the question of criteria (question 4). 

We will utilize the concept of conditionally effective 
evaluation introduced in [3], i.e., evaluation which has better 
precision characteristics with consideration of limitations 
according to other criteria (labor intensiveness of the algo- 
rithm, stability in relation to -change in the law of error dis- 
tribution), In each individual situation (except the most 
simple), the solution may be obtained only with • application 
of the statistical modeling method on an electronic computer 
with consideration for machine time expenditure. The methodology 
of such an investigation in our case is analogous to that used 
in [3]. However, the compared evaluation algorithms will also 
be distinguished by whether or not composition was employed, in 
them. \ It is clear that the result of such- an investigation in 
its overall form cannot be predicted. In the simplest case, 
conclusions may be obtained analytically and speak in favor of 
composition . 
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3 . Investigation of the Simplest Case 


As the simplest case, let us examine a linear model with 
normal law of error distribution. As is known [4] , evalua- 
tions of the method of | least , • squares are the best in this 
case by their precision characteristics. Due to the fact 
that there are simple analytical expressions for these evalua- 
tions, the criterion of algorithm labor intensiveness may be 
considered insignificant. Thus, we have only to compare al- 
gorithms using and not using decomposition by their precision 
characteristics. For greater clarity (although this is not 
necessary), we will limit ourselves to the case m = 2, k = 2, 
i.e., we will examine model 

' y =e i X, + &rX>,4 4 , ; 

' * . ..... . (2) 

where error £ — independent normally distributed random values 

• 2 

with zero mathematical expectation and dispersion <3 

• 2 

We will take the overall number of measurements equal to N = n 
and we assume that plan matrix X has the form 
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^ 7, 'Th l -r2 n- S' 

(n-t)f 5) 


( 5 ) 


o! 


Thus, in processing without decomposition 3 the covariational 
evaluation matrixj^^ Q 2 ) is equal to j 6 J (x T xr‘ • i-e- e and 

o 2 


separately are' determined with dispersion 

: n .r ; 'tteWn-O . 

®8, - (h-,)(V+2n-5) 


( 6 ) 


In the case of processing utilizing decomposition instead 
of model (2), we first obtain n of individual models 
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h X <i- { 


= i,n 


with the same plan matrix 

0 1 
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In this case the error matrix appears as 
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and I C with dispersions 

\d 


By n we have obtained evaluation ; 

determined by jg 2, and (9). Prom here 4 ' for resulting evaluation 

i 

; © j J (IK index marking the use of decomposition) 3 we will ob- 
tain dispersion 

' -42 <5^ ~ 

4 n z - 1 


( 10 ) 
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For evaluation Q^j > we have problem 


A 

c 


. Li 


( 11 ) 




with plan matrix 


Xz = 


0 

j_ 

M 

i • • 

n- 1 

n 


; (X 2 t X z )’= 




(h-<)(Zh-0 


(12) 


and dispersion^ 1 - , equal to 2 O' {lllzll- (see (9)). 

' c ! n (n+O 


From here we quickly obtain /8 

Lt 2e 2 (?n-i) 6 * _ .^2g g 

jV§2<i ” n(h + 0 (n.i;(irt-«; hM ! (13) 

Comparing formulas (10) and (13) with formula (6), we ob- 
tain increase in dispersion due to decomposition (we omit in- 
dexes 1 , 2 and 1 Q J ) : 

i i. - i 

L <%< - lnL2n-5 . i (14) 

• n 'SIT 7 ' ~ 2ln*'H2 n ’<) 

■ fiiu A„ = q- • (15) 

To explain reasons for reduced precision with decomposi- 
tion, we will note that in both cases the evaluations are linear 
functions of measurements , but with decomposition the co- 
efficients during individual measurements are not optimal, since 
they have the form ,-<1 . & i - /, ft , Jr ^ 'n\ correspond [to values 

jx. = ~ , Xi - y instead of iC<^ . Concrete expressions for 
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“ d Ci <i . 

show that / Ca Vj 

w 


(which for brevity we do not write out) 

M • 


We will note in conclusion that an analogous calculation 
may be performed for more complex linear models as well as for 
nonuniform distances between measurement points according to 
individual variables . 


4 . Example of a More Copplex Problem . 


We will limit ourselves once again to the case of two 
independent variables, which mpy be more conveniently expressed 
asjzj an<J r£. Moreover,^. ,£ ■ ,J y. = ij! (tj= V *);' 1 
the dependent variable will be expressed as Z. Further, let 

( 16 ) 


Zij = 


where 




are again independent normally distributed random 
values with zero mathematical expectation and dispersion ' i , 
and 1 Mil’ 6 ) jhas the form 

- 1 _ V / . 0 \ /J X'l 


fr(x,y>Q) % — , exp 

1 ZXGx&Al-Q} r 


/ 
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A~cL 


2X6xA\l\-g 


i ex ? 


g& : Sxrffvi sij 

' .<■ ly-g,) 1 

2U-ftVl ~ *1 Jj 


•( 17 ) 
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Thus, in our example 

|g r (c^Ci,, &>,<$*, >- (18) 


that is, l'<-s 'll 
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Solution of the problem without decomposition using the 
method of . f~least ; squares is reduced to minimalization of the 
expression 

•S = | X L' 2 y - ( i 9 ) 


according to 0,, with which we obtain evaluation 


,/S 

& 


We will 


note that the problem of minimalization of S' may turn out to be 

■ | A \ 

Let us examine a series of algorithms 


multiextremal . 
of minimalization. 


(Also included in the algorithm is the 


given rule of the end of computation, for example — | number o f 
Corresponding to each algorithm will be a certain 
and a set of precision evaluation charac- 


iterations . ) 


computation time ft u 

■a ' r 

teristics eL\ , 
variational* matrix 


'foi? example, displacement vector 


’Al 


and co- 


9 . The problem of selecting y becomes 

i 

the problem of vector' optimalization. Putting aside the ques- 
tion of selecting y for the time being, let us examine the 
variant of applying decomposition. 


With fixed , we obtain, instead of (17), an indivi- 

dual model (we will note that decomposition is not simple by 
parameters ) : 

ix,9,) ^ a expl~t(x-aolc(X’iy+ d J + f expj~?(x<iJ+p(Wz)-<J,j 


in which there are ten parameters: 
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To evaluate 0^ , it Is necessary to minimize expression 


( n t ime s [with respect to j) j 


$,j = 


(22 ) 


i~l 


I A .■ 

We are examining a series of algorithms 1 n y'j . At the next 
stage, considering each value of as a measurement of 

initial vector of parameters 0, we obtain a system which looks 
like 


I ^ 


' 6,, * a, t tj ; 

1 % = 

! 5 : = 04 


- i.n 


s 






J 


(23) 


• %■ * 


From this system, 10 n measurements are required to evaluat e fi_. - 

The difficulty here lies in the fact that errors #x; 

__ ___ 'V 

have already been correlated and, generally speaking, do not have 

zero mathematical expectation. 


In studying the problem by the method of statistical exami- 
nation, we know- the characteristics of errors and may continue 


/II 


9 



evaluation of Q by minimalization of 'the corresponding overall 
square form. However, in solving a real problem we have no 
such opportunity. Therefore, for comparative evaluation of 
the variant of decomposition, we will use ordinary sums of 
squares (here it becomes possible to achieve partial (separation 

S di = X ( % - G iL dT" S ( - a *) ; 

|^ 3 S' SvjT^) + (f’ 


of parameters)./! 

V 7 


2(I-S‘)6x: 


% I 

l+i 


Y(2H) 

! 


\( * p.hj- 0 f,q. 'jsscltf 

v<f w-wejJJ 

q'j.. f 17? - i . 

'<j - 1 — — id 

Expressions of items not written out for p^M 1 , are evident 

from (21) by analogy with j • 


From expressions for ] and Sjki 


; <WX% 


we promptly obtain 
o (25) 


For minimalization of 
gorithms 


Av“ . Ay"’ 


we use a set of al- 


Sd 3 , and 3d, . ... 

y , . We will designate as /4y the overall 

algorithm for solving the problem in case of decomposition, 
i.e., !v~(v, / y j y M )' ? • For each Ay we will again obtain the 
overall time for solving the problem |*ty; and a set of precision 
characteristics-^^ ^ # 

Now the question of feasibility of decomposition may be 
answered . 


10 



First, it is necessary to select an approach to the problem 
of vector optimalization. For example, let the computation time 
be given by limitation 




( 26 ) 


and the vector of precision characteristics ! convoluted in scalar 
criteria — average quadratic deviation of a certain"; linear form 
from components t£j , i.e.. 


*2 > 1 2 . 


(e) *.M [f 


(27) 


There remains the difficulty that both t and e depend on the 
value of the evaluated parameter 0 . Let 0 change in a certain 
domain , Then the minimaxal approach may be used and (26) 
and (27) be repla ced by 

■k± Sup_ i{6) s -t 0 ; 

■ ■ . j (28) 

t = sup e(e ) . 

etQ C 29 ) 

Now t and e depend only on selected algorithms and A v • 

Leaving bn ly those A and A v for which (28) is being ful- 
filled and selecting one of the remaining algorithms from the 
condition of minimum e, we solve the problem to its end. Let 
A be the algorithm selected. If A = A , i.e., one of the al- 
gorithms is without decomposition, not only is the nonfeasibil- 
ity of decomposition demonstrated, but the best algorithm for 
solving the problem is found. If A q = & vo , i.e., one of the al- 
gorithms has decomposition, then decomposition is feasible and . 
again the best algorithm is found. We will note that we were 
able, to include in this comparison also various realizations of 
decomposition itself (i.e., not only of type (20), but also 
others ) . 
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Realization of the described procedure with the aid of 
statistical modeling on an electronic computer is possible 713 

with a small number of values of y and v . A number of views 
on such a realization, particularly on multiextremal and vec- 
tor optimalizat ion , is given in [5] . 


5. Conclusions 


Thus, in evaluating parameters of multidimensional models, 
three cases are possible. 

1. If the problem consists of selecting the best model, 
then it is expedient to perform decomposition either at the 
stage of planning the experiment or, if this is impossible, at 
the processing stage. 

The latter may be done by constructing segments ;[2J . 

2. For linear models under conditions of utilizing the 
method of [ least squares (.for example, with normal law of 
error distribution), decomposition is not feasible. If the 
experiment has already been conducted according to a scheme 

of decomposition, processing of results should be done accord- 
ing to the general model, 

3. In all intermediate cases, the solution to the question 
of feasibility of decomposition depends on the concrete problem 
and may be obtained on the bases of a special investigation 
utilizing the method of statistical modeling, with considera- 
tion of all significant criteria, including labor intensive- 
ness of the evaluation algorithm. The methodology of such an 
investigation is given above (section 4). 
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